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1.  Introduction 

In  this  note  we  present  results  for  a  general  class  of  spline  approxima¬ 
tions  for  nonlinear  functional  differential  equations  (FDE) .  The  results  of 
§2  below  extend  to  a  broad  class  of  nonlinear  FDE  the  basic  state  approximation 
theorems  based  on  spline  methods  developed  earlier  for  linear  FDE  in  [3] .  Our 
methods  here  do  not  employ  a  Trotter-Kato  type  theorem  (the  results  for  linear 
systems  in  [3]  as  well  as  those  for  autnomomous  nonlinear  FDE  in  [6]  are  based 
on  Trotter-Kato  approximation  theorems) .  Rather,  we  use  only  simple  ideas 
(Gronwall's  inequality  in  a  manner  similar  to  that  in  [1]  where  another  class 
of  approximations  for  nonlinear  control  systems  is  developed)  involving  a 
dissipative  condition  on  the  nonlinear  operator  generated  by  the  right-hand  side 
of  our  nonlinear  FDE.  (For  other  spline  approximation  results  for  nonlinear 
FDE,  see  [8],  [9].) 

The  ideas  developed  here  are  sketched  for  a  specific  class  ("first-order" 

or  "piecewise  linear"  splines)  of  approximations,  but  a  careful  reading  of  (3) 

in  conjunction  with  analysis  of  our  presentation  below  should  convince  the 

reader  that  our  results  extend  immediately  to  classes  of  higher-order  spline 

N  N  N 

methods  based  on  the  approximation  scheme  A  -  P  AP  used  in  [3]  and  below. 

The  state  approximation  results  of  S2  are  given  under  a  global  Lipschitz 
hypothesis  on  the  system  that  is  sufficiently  weak  so  as  to  include  many 
systems  arising  in  applications  as  special  cases.  Our  results  can  be  developed 
(at  the  expense  of  considerable  added  technical  argument)  under  somewhat  weaker 
conditions  based  on  local  Lipschitz  criteria  in  certain  of  the  arguments 
appearing  in  the  right-hand  side  of  our  FDE  system.  We  do  include  in  our 
treatment  nonautenomous  systems  such  as  those  commonly  found  in  control  and  iden¬ 
tification  problems.  In  fact,  in  |3  below  we  indicate  how  our  results  apply 


2. 


directly  to  parameter  identification  problems  and  present  some  of  our  numerical 

findings.  The  applications  of  the  approximation  theorems  of  §2  to  the  nonlinear 

system  identification  problems  of  S3  are  analogues  to  the  linear  system  spline 

approximation  identification  techniques  discussed  in  [2] . 

In  obtaining  our  state  approximation  results  (along  with  error  estimates) 

in  §2  we  require  a  differentiability. assumption  on  the  right-hand  side  of  the 

FDE  in  addition  to  the  global  Lipschitz  hypothesis.  This  appears  essential 

for  our  approach,  which  relies  on  convergence  of  the  approximating  operators 

AN  along  solutions  of  the  FDE  (this  in  turn  requires  certain  minimal  smoothness 

criteria  on  trajectories) .  In  contrast,  the  autonomous  Trotter-Kato  nonlinear 

approximation  result  developed  in  [6]  requires  only  the  global  Lipschitz 

hypothesis.  Of  course,  to  provide  error  estimates,  that  approach  must  also 

include  the  additional  differentiability  condition. 

■j  *1 

Throughout  we  shall  use  the  notation  HJ  or  HJ(a,b)  to  denote  the  usual 
Sobolev  spaces  (a,b>Rn)  of  Revalued  functions »  with  H°  =  L_(a,b). 

2.  State  Approximation  for  Nonlinear  Systems 
We  consider  the  system 

(2.1)  x( t)  *  f(x(t)  ,x^,x(t— t^)  ,  ...,  x(t-Ty>)  +g(t),  0  5.  t  <.  T, 


where  f  -  f  (D,*^, . .  .,yy) «  Z  *  RnV  -*>  Rn.  Here  Z  -  Rn  x  L2(-r,0;Rn)  , 

0  <  Tj  <  . . .  <  tv  -  r,  xfc  denotes  the  usual  function  xfc(0)  *  x(t+0), 

-r  1  0  1  0,  and  4  E  H^(-r,0) .  We  shall  make  use  of  the  following  hypotheses 
throughout  our  presentation. 


3. 


(HI)  :  The  function  f  satisfies  a  global  Lipschitz  condition: 

v 

|f(n,ihy1,...,yv)-f(€#$»w1,...,wv)  |  <  k{  |n-C|  +  U-? |  +  £  I yi_wi I  > 

i=l 

x\\) 

for  some  fixed  constant  K  and  all  (n.'l'/y^ » . . .  ,yy) ,  (£,1(1^ , . . .  ,wy)  in  Z  x  r 
(H2) :  The  function  f:  Z  x  Rnv  -*■  Rn  is  differentiable. 

Remark  2.1.  If  we  define  the  function  F:  Rn  *  C(-r,0;Rn)  C  Z  -*■  Rn  given  by 

(2.2)  f (z)  =  F(n,i|0  =  f  (n *♦  <— , . . .  ) 

we  observe  that  even  though  f  satisfies  (Hi) ,  F  will  not  satisfy  a  continuity 
hypothesis  on  its  domain  in  the  Z  norm. 

He  define  the  nonlinear  operator  A:  D(A) C  Z  +  Z  by 

D(A)  *  W  =  {(<|i(0)  **)  I*  G  ^(-*,0)  } 

A  (iji  (0)  ,i|i)  =  (F(«p(0)  ,*)  ,  D*) 


where  here  D<»  ”  41 '  • 

Theorem  2.1.  Assume  that  (HI)  holds  and  let  y(.t>$,g)  “  (x(t>$»g)  »xtO,g)) 
where  x  is  the  solution  of  (2.1)  corresponding  to  (6H1,  g  €  L^.  Then  for 
C  -  (<H0>,+),  y(+,g)  is  the  unique  solution  on  [0,T]  of 

t 

(2.3)  s(t)  -  c  +  J{As(o)+(g(o) ,0) }dc. 

0 


» 


4. 

Furthermore,  g  -*•  z(t;4,g)  is  weakly  sequentially  continuous  from  (weak)  to 
2  (strong) . 

Our  proof  of  Theorem  2.1  follows  ideas  of  D.  Reber  (see  [10]  and  52,  53 
of  [11])  and  employs  a  very  general  fixed-point  theorem  (a  "uniform  contraction" 
result  -  see  [5,  p.  7]  -  that  is  by  now  well  known  to  those  working  in  dynamical 
systems)  to  establish  existence  and  continuous  dependence  of  solutions  of 

(2.3) .  For  existence,  uniqueness  and  continuous  dependence  of  solutions  of 
(2.1),  we  note  that  our  condition  (HI)  is  a  global  version  of  the  hypothesis 
of  Kappel  and  Schappacher  in  [7] ,  so  that  their  results  yield  immediately  the 
desired  result  for  (2.1) . 

The  uniqueness  of  solutions  to  (2.3)  follows  in  the  usual  manner  once  we 
establish  that  A  satisfies  a  dissipative  inequality.  Indeed,  defining  a 
weighting  function  g  exactly  as  in  [3,  p.  500]  and  the  corresponding  weighted 
inner  product  <,>^  on  Z,  one  can  show  without  difficulty  that  (HI)  implies 
the  dissipative  inequality  (see  [4,  p.  71])  for  the  nonlinear  operator  A 

Z-W>£ 

for  all  z,w  €  D(A) . 

Turning  next  to  the  approximation  of  (2.1)  through  approximation  of 

(2.3) ,  we  let  ZN  be  the  spline  subspaces  of  Z  discussed  in  detail  in  [3].  For 
the  sake  of  brevity  we  here  outline  the  results  for  the  piecewise  linear 
subspaces  Z^  (see  $4  of  [3])  given  by  Z^  ■  {(4(0)  ,4)  |4  is  a  continuous 
first-order  spline  function  with  knots  at  t ^  -  -jr/N,  j-0,1, . . . ,N).  A  careful 
study  of  the  arguments  behind  our  presentation  reveals  that  the  approximation 


(2.4) 


<Az-Aw,z-w>^  £  <o<z-w, 


results  given  here  hold  for  general  spline  approximations.  For  example,  if 

one  were  to  treat  cubic  spline  approximations  (Z^  of  13]),  one  would  use  the 

appropriate  analogues  of  Theorem  2.5  of  [12]  and  Theorem  21  of  [13]  (e.g., 

see  Theorem  4.5  of  [12])  .  Hereafter,  when  we  write  Z  ,  the  reader  should 

N 

understand  that  we  mean  of  [3] . 

N  N  N 

Let  P  =  P^  be  the  orthogonal  projection  (in  <,> )  of  Z  onto  Z  so  that 

from  [3]  we  have  immediately  that  PNz  ■*  z  for  all  z  E  Z.  As  in  [3],  we  define 

N  N  N 

the  approximating  operator  A  =  P  AP  and  consider  the  approximating  equations 
N 

in  Z  given  by 

t 

(2.5)  zN(t)  -  PN?  +  |{ANzN(o)  +  PN(g(o),0)}da 

0 

which,  because  ZN  is  finite-dimensional,  are  equivalent  to 


zN(t)  =  ANzN(t)  +  PN(g(t),0) 


zN(0)  *  p\. 


From  (2.4)  and  the  definition  of  AN  in  terms  of  the  self-adjoint  projections 
PN,  we  have  at  once  that  under  (HI)  the  sequence  {AN}  satisfies  on  Z  a  uniform 
dissipative  inequality 

(2.7)  <ANz-ANw,z-w>  <  u<z-w,z-w>  . 

9  9 

Uniqueness  of  solutions  of  (2.5)  then  follows  immediately  from  this  inequality. 
Upon  recognition  that  (2.6)  is  equivalent  to  a  nonlinear  ordinary  differential 
equation  in  euclidean  space  with  the  right-hand  side  satisfying  a  global 
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Lipschitz  condition,  one  can  easily  argue  existence  of  solutions  for  (2.6) 
and  hence  for  (2.5)  on  any  finite  interval  [0,T].  Our  main  result  of  this 
section,  which  insures  that  solutions  of  (2.6)  converge  to  those  of  (2.1), 
can  now  be  stated. 

Theorem  2.2.  Assume  (HI),  (H2)  .  Let  C  =  (<f>  (0)  ,<j>)  ,  $  6  H1  and  g€H°(0,T) 

N 

be  given,  with  z  and  x  the  corresponding  solutions  on  [0,T]  of  (2.6)  and 
(2.1),  respectively.  Then  zN(t)  -*■  y(t)  =  (x(t;$,g)  , x^ (i}> ,g) )  ,  as  H  +•, 
uniformly  in  t  on  [0,T], 

Remark  2.2.  One  can  actually  obtain  slightly  stronger  results  than  those 
given  in  Theorem  2.2.  One  can  consider  solutions  of  (2.1)  and  (2.6)  corres¬ 
ponding  to  initial  data  (x(0) ,xQ)  =  (n,$)  =  £  with  n  S  R°,  4>  S  H°  (i.e.  (G  Z) 
and  argue  that  the  results  of  Theorem  2.2  hold  also  in  this  case. 

To  indicate  briefly  our  arguments  for  Theorem  2.2,  we  consider  for  given 
initial  data  £  and  perturbation  g  the  corresponding  solutions  z  and  zN  of 
(2.3)  and  (2.5).  Defining  AN(t)  =  zN(t)-z(t)  and  G(t)  =  (g(t) ,0) ,  we  obtain 
immediately  that 

t 

(2.8)  AN(t)  -  (PN-I)C  +  j{ANzN(o)-Az(o)+(PN-I)G(o)}do. 

0 

He  next  use  a  rather  standard  technique  for  analysis  of  differential  equations 
(see  [4]),  the  foundations  of  which  we  state  as  a  lemma  since  we  shall  refer 


to  it  again. 
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Lemma  2.1.  If  X  is  a  Hilbert  space  and  x:  [a,b]  +  X  is  given  by  x(t)  = 
t  ,  ,  t 

x(a)  +  /  y(o)do,  then  |x(t)|  =  |x(a)|  +  2 /  <x(a) ,y(o)>do. 


This  lemma  is  essentially  a  restatement  of  the  well-known  result  [4,  p.  100] 
that  ^  ^|x(t) |2  =  <x(t) ,x(t)>. 

Applying  Lemma  2.1  to  (2.8),  we  obtain 


| AN(t) | 2  =  | <PN-I) c| 2  +  2  |<ANzN(o)-Az(o)+(PN-I)G(o) ,AN(o)>do 

0 

t 

*  | <PN-I) c | 2  +  2  |<ANzN(o)-ANz(0) ,AN(a)>da 

0 

t 

+  2  |<(AN-A)z(cr)  +  (PN-I)G(a)  ,AN(o)>do. 


If  we  use  (2.7)  on  the  first  integral  term  in  this  last  expression,  we  then  have 

t 

| AN(t)  | 2  <  |  (PN-I)  c| 2  +  2  |o>|AN(o)  |2do 

0 

t 

+  2  |<(AN-A)z(o)+(PN-I)G(a) ,AN(o)>do 
0 

t 

<  [  <PN-m(2  +  2  ju|AN(a)  |2do 

0 

t 

+  2  |  {||(AN-A)z(0)|2  +  ||aN(0)|2  +  ||(PN-I)G(o)|2  +  i|AN(o)|2)do 
0 

t  t 

-  | <PN-I) c | 2  +  | I (AN-A)z(a) |2da  +  | I (PN-I)G(o) |2da 

0  0 

t 

+  (2a»+l)  2do. 
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An  application  of  Gronwall's  inequality  to  this  then  yields  the  estimate 

(2.9)  |AN(t)|2  <  {e  (N)  +  e  (N)  +  e  <N)}e2(a)+1,t 

•L  2, 


where 


e1(N)  =  | (PN-I)s|2, 

T 

e2(N)  =  j| (aN-A)z(o) |2do, 

0 

T 

e3(N)  =  j| (PN-I)G(o) | 2da . 

0 

N  i  N  i 

Since  P  •>  I  strongly  in  Z  and  the  convergence  |  (P  -I)G(o)  |  -*■  0  in  is 

dominated,  to  prove  Theorem  2.2  it  suffices  to  argue  that  e2(N)  0  as  N  *  00  • 

To  that  end,  we  state  the  following  sequence  of  lemmas. 

Lemma  2.2.  Assume  (HI)  and  let  $  =  {z=($(0)  >$)  |$  G  H2}.  Then  ANz  -*•  Az  as 
N  -*•  °°  for  each  z  G 

Lemma  2.3.  Let  J  =  {(;,g)  G  W  x  H°(0,T)  | G  H2,  gG  H1,  with  (0)  = 

F(0,0)+g(0)  where  t,  ■  (4>(0)  ,4>) }.  Assume  that  (HI),  (H2)  obtain.  Then  for 
(5,g)  G  J*  the  corresponding  solution  a  •*  z(c)  «  (x(o) ,xo)  of  (2.3)  (x  is 
the  solution  of  (2.1))  satisfies  z(o)  G  ^  for  each  o  G  [0,T]. 

Lenma  2.4.  Assume  (HI),  (H2)  and  let  (t,g)E  with  zN  and  z  the  corresponding 
solutions  of  (2.5)  and  (2.3).  Then  zN(t)  -*■  z(t)  uniformly  in  t  on  [0,T). 


» 


9. 

Lemma  2.5.  Assume  (HI).  Then  the  solutions  of  (2.3)  and  (2.5)  depend  con¬ 
tinuously  (in  the  Z  *  H°  topology)  on  (C,g)  in  W  x  H°,  uniformly  in  t  on 
[0,T]  . 

Lemma  2.6.  The  set  J?  defined  in  Lemma  2.3  is  dense  in  Z  *  H°. 


We  obtain  the  convergence  of  Theorem  2.2  by  combining  Lemmas  2.4,  2.5 
and  2.6.  The  proof  of  Lemma  2.5  employs  Lemma  2.1  along  with  Gronwall's 
inequality  in  much  the  same  way  as  we  did  above  in  deriving  (2.9)  from  (2.8). 

We  note  that  Lemma  2.3  requires  hypothesis  (H2)  (this  is  the  only  place  in 
which  it  is  used)  in  order  to  obtain  enough  smoothness  of  solutions  z  of 
(2.3)  so  that  z(o)  £  %  for  each  o. 

In  developing  the  estimates  to  establish  Lemma  2.4  (which,  by  our  above 

remarks,  requires  only  that  we  argue  e2(N)  0),  we  use  heavily  the  standard 

N 

spline  estimates  found  in  [12]  and  [13],  Lemmas  2.2  and  2.3  yield  that  A  z (a) 

-+•  Az(o)  for  each  a  so  that  to  prove  Lemma  2.4  one  only  need  show  that  this 

convergence  is  dominated,  thereby  guaranteeing  e2(N)  -*■  0.  In  making  the 

arguments  for  Lemma  2.4,  one  obtains  at  the  same  time  error  estimates  on  the 

convergence  in  Theorem  2.2.  For  example,  one  readily  finds  the  followings 
2 

For  <f>  £  H  ,  f  satisfying  (HI),  (H2)  ,  <K0)  =  F(0,0)  and  g  =  0,  the  convergence 

N 

z  (t)  -*•  z(t)  is  0 ( 1/N)  .  For  higher-order  splines  and  higher-order  convergence 
estimates  (e.g.  cubic  splines  with  convergence  0{1/N3)),  one  of  course  needs 
additional  smoothness  (beyond  (H2))  on  f. 

The  convergence  given  in  Theorem  2.2  yields  state  approximation  tech¬ 
niques  for  nonlinear  FDE  systems  based  on  the  spline  methods  developed  in  [3] . 

These  results  can  be  applied  to  control  and  identification  problems,  the  latter 
of  which  we  discuss  in  the  next  section. 

t 
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We  may  then  consider  the  approximating  sequence  of  identification  problems 
of  minimizing  over  Q  the  error 

(3.5)  JN(q)  =  l  |cxN(t. ;q)-5. |2 

i=l  1  1 

N  N  N 

where  z  (t;q)  =  (x  (t;q),y  (t;q))  is, the  solution  of  (3.4).  Using  modifications 
of  the  ideas  and  results  of  12,  we  can  then  prove  the  following  theorem. 

N 

Theorem  3.1.  Let  q  be  a  solution  of  the  problem  of  minimizing  (3.5)  over  Q. 

N  N- 

Then  {q  }  possesses  a  subsequence  {q  3}  which  converges  to  some  q  in  Q  which 
is  a  solution  of  the  problem  of  minimizing  (3.1)  subject  to  (3.2).  If  this 
latter  problem  has  a  unique  solution  q,  then  the  sequence  {q  }  itself  converges 
to  q. 

N 

Since  A(q)  and  A  (q)  satisfy  (2.4)  and  (2.7)  uniformly  in  q  €E  0,  we  have 
N 

from  Theorem  2.2  that  z  (tjq)  z(t;q)  for  each  qGQ.  Then  if  we  choose  a 

N.  N  N.  A 

subsequence  (q  3}  of  the  sequence  {qN}  of  the  theorem  above  with  q  3  -*■  q  £  Q 

(Q  is  compact) ,  we  have  that  for  any  q  £  Q 

N .  N  N 

(3.6)  J  3(q  3)  <  J  3  (q)  . 

N  N  N  a 

But  J  3 (q)  -*■  J(q)  and  if  we  establish  that  z  3(t;q  3)  -*■  z(t;q)  whenever 
N  A 

q  3  -*•  q,  we  find,  upon  taking  the  limit  in  (3.6),  that  J(q)  <_  J(q),  so  that  q 
is  a  minimizer  for  (3.1),  (3.2). 

Thus  to  establish  Theorem  3.1,  one  only  need  argue  that  qN  -*■  q  implies 
zN(t;qN)  -*•  z(t?q).  This  can  be  done  by  following  almost  without  change  the 


12. 


sequence  of  arguments  behind  Lemmas  2.2  -  2.5  above.  Indeed,  defining  the 

..(j  N  N  N  N  N 

approximating  operators  =  A  (q  )  =  P  A(q  )P  and  considering  the  equations 

t 

(3.7)  z(t;q)  =  £  +  j{A(q) z(o)+(g(a) ,0) }do 


(3.8)  zN(t;qN)  =  PNC  +  (a^zN(a)  +PN(g(o)  ,0)  }do  , 

« 

0 

one  finds  thatja^11  satisfies  the  uniform  dissipativeness  condition  (2.7)  and 
that  Lemmas  2.2,  2.3  and  2.4  hold  forJ3^N,  A(q)  and  (3.7),  (3.8)  in  place  of 
AN,  A  and  (2.3) ,  (2.5) . 

We  have  tested  numerically  procedures  based  on  the  above  ideas  and  present 
next  a  sample  of  our  numerical  findings. 

Example  3.1.  Consider  the  example 

a  x(t-2) 

x(t)  =  aQx(t)  +  aix(t-l)  +  1+x(t_2) 
x0  E  1' 

which  can  be  integrated  (numerically)  using  the  step  method  to  obtain  values 
?i  =  x(ti)  to  be  used  as  "observations"  in  (3.1)  and  (3.5).  This  was  done 
with  the  "true"  values  of  a^  »  2.0,  a^  «  5.0,  a^  ”  3.0  and  we  then  used  the 
above  methods  to  identify  the  parameters  a^  (the  author  wishes  to  express  his 
appreciation  to  P.  Daniel  for  her  efforts  in  developing  the  software  packages 


» 


used  for  these  and  numerous  other  computations  employing  spline  methods  for 

parameter  estimation) .  At  each  value  of  N,  a  standard  least-squares  IMSL 

package  based  on  the  Levenberg-Marquardt  algorithm  was  used  to  find  a  minimum 

for  (3.5)  With  q  =  (a^,a2>  or  q  =  (a0>a2) .  Our  findings  are  reported  in 

N  A 

tabular  form  below.  We  note  that  the  convergence  q  -*•  q  is  clearly  second-order. 

Table  3.1.1s  Identify  a,  and  a„  with  start-up  values  a,  „  =  4.0, 

— ~  =  "  12  X  i  U 

a  n  =  2.0  for  each  value  of  N. 

Z  /  u 


N 

ai 

a2 

2 

7.006 

2.036 

4 

5.499 

2.796 

8 

5.126 

2.950 

16 

5.032 

2.987 

32 

5.008 

2.996 

TRUE  VALUES:  ^  =  5.0,  a2  =  3.0 

Table  3.1.2:  Identify  a_  and  a„  with  start-up  values  a„  „  =  .5, 

“  0  2  UfU 

a  =  4.5  for  each  value  of  N. 

2 


N 

N 

ao 

N 

a2 

2 

2.158 

3.645 

4 

2.042 

3.193 

8 

2.011 

3.050 

16 

2.003 

3.012 

32 

2.0007 

3.0026 

TRUE  VALUES: 

*0  -  2.0,  a2  -  3.0 

» 


« 
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